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DETAILED ACTION 

1 . This action is responsive to communications: Election filed on 3/20/07. 

2. Claims 1 - 17 are pending in the case. Claims 1, 8, 12 and 16 are independent. 

Priority 

3. Applicant is advised of possible benefits under 35 U.S.C. 1 19(a)-(d), wherein an 
application for patent filed in the United States may be entitled to the benefit of the filing 
date of a prior application filed in a foreign country. 

4. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which 
papers have been placed of record in the file. 

Claim Rejections - 35 USC § 101 

5. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

6. Claim 16 is rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. Claim 16 is considered software per se. 
Computer programs may be explicitly claimed as, for example, a series of code or 
instructions for performing functions or may be implicitly claimed as, for example, a 
system, a module or an apparatus, the former being the case here. 
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Claim Rejections - 35 USC § 102 
1. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

8. Claims 1 - 4 and 8-16 are rejected under 35 U.S.C. 102(b) as being clearly 
anticipated by Nielsen (Designing Web Usability). 

9. Regarding independent claim 1, Nielsen teaches that spoken words are 
sometimes harder to understand, especially if the speaker is sloppy, has a dialect, 
speaks over a distracting soundtrack, or simply speaks too quickly. The classic solution 
to these problems is to use subtitles (p 1 , fourth full paragraph), which meet the 
limitation of a text display time calculation processing unit for calculating a display 
time period of text media to be included in said output multimedia contents, on 
the basis of conversion instruction information; 

Nielsen teaches that traditional subtitles look good on a full-sized videotape. 
Unfortunately, the subtitles are virtually unreadable when the video is reduced to the 
size usually transmitted over the Internet (left image). Much better readability is gained 
from placing the subtitles in a letterbox and sizing them for computer viewing (right 
image) (p 2, second full paragraph), which meet the limitation of a spatiotemporal 
layout information setting processing unit for setting spatiotemporal layout 
information on said output multimedia contents on the basis of said conversion 
instruction information; and 
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Nielsen teaches that to preserve the feeling of user control, even when 
presenting multimedia, try segmenting longer presentations into short chapters that can 
be chosen from a menu. When converting a television news program to the Web, for 
example, break the program into one segment for each news story (p 2, third full 
paragraph), which meet the limitation of a contents conversion processing unit for 
converting said input multimedia contents into said output multimedia contents 
on the basis of said spatiotemporal layout information, 

Nielsen teaches that we can save download time by transmitting the subtitles as 
ASCII (or Unicode) and have them rendered in the letterbox on the client machine: a 
perfect job for an applet. It should also be possible to have the user select the language 
for the subtitles through a preference setting or a pop-up menu (p 2, last paragraph), 
which meet the limitation of said spatiotemporal layout information setting 
processing unit setting a display time period of said text media included in said 
spatiotemporal layout information, on the basis of said display time period of said 
text media calculated in said text display time calculation processing unit, and 
setting a playing time period of said media other than said text media included in 
said spatiotemporal layout information, on the basis of said display time period of 
said text media set as said spatiotemporal layout information. 

10. Regarding dependent claim 2, Nielsen teaches that traditional subtitles look 
good on a full-sized videotape. Unfortunately, the subtitles are virtually unreadable 
when the video is reduced to the size usually transmitted over the Internet (left image). 
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Much better readability is gained from placing the subtitles in a letterbox and sizing 
them for computer viewing (right image). Doing so does not increase the file size 
proportionally because the black area compresses very nicely (p 2, second full 
paragraph), which meet the limitation of said text display time calculation 
processing unit calculates said display time period of said text media to be 
included in said output multimedia contents, on the basis of text information 
obtained from said input multimedia contents and text display from information 
inputted as said conversion instruction information. 

1 1 . Regarding dependent claim 3, Nielsen teaches that to preserve the feeling of 
user control, even when presenting multimedia, try segmenting longer presentations 
into short chapters that can be chosen from a menu. When converting a television news 
program to the Web, for example, break the program into one segment for each news 
story. Then, prepare a standard web page that lists the stories with a short summary 
and a single thumbnail photo from the most visual ones. Allow users to link to individual 
stories from this page (p 2, third full paragraph), which meet the limitation of said 
spatiotemporal layout information setting processing unit sets a playing time 
period of said media other than said text media included in said spatiotemporal 
layout information to coincide with said display time period of said text media set 
as said spatiotemporal layout information. 
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12. Regarding claims 8 - 10, 12 - 14 and 16, the claims incorporate substantially 
similar subject matter as claims 1 - 3 and are rejected along the same rationale. 

Claim Rejections - 35 USC § 103 

13. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

14. Claims 4, 1 1 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Nielsen (Designing Web Usability) as applied to claims 1, 8 and 12 above, and 
further in view of Oliver et al. (Sams Teach Yourself HTML and XHTML). 

1 5. Regarding dependent claim 4, Nielsen teaches that to preserve the feeling of 
user control, even when presenting multimedia, try segmenting longer presentations 
into short chapters that can be chosen from a menu. When converting a television news 
program to the Web, for example, break the program into one segment for each news 
story (p 2, third full paragraph), which meet the limitation of a segment playing time 
setting unit for setting a playing time period of each of segments of said media 
other than said text media to be included in said output multimedia contents; 

Nielsen teaches that then, prepare a standard web page that lists the stories with 
a short summary and a single thumbnail photo from the most visual ones. Allow users to 
link to individual stories from this page (p 2, third full paragraph), which meet the 
limitation of a total playing time calculation unit for calculating a total playing time 
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period of all said segments of said media other than said text media on the basis 
of said playing time period of each of said segments of said media other than 
said text media set in said segment playing time setting unit; 

Nielsen does not explicitly teach a repeat count setting processing unit for 
setting a repeat count of said media other than said text media on the basis of 
said display time period of said text media calculated in said text display time 
calculation processing unit and said total playing time period of all said segments 
of said media other than said text media, nor said contents conversion 
processing unit making a conversion of said media other than said text media 
included in said input multimedia contents on the basis of said repeat count set 
in said repeat count setting processing unit. 

Oliver et al. teach that The HTML page in Figure16.3 demonstrates the use of 
<embed /> with a video clip in the Windows AVI (Audio-Video Interleave) format. The 
<embed /> tag in Figure 16.3 also includes the autostart and loop attributes, which tell 
Netscape's LiveVideo plug-in to start playing the video when the page loads and to 
repeat it as long as the page is being displayed (p 1 , first paragraph), which meet the 
limitation of a repeat count setting processing unit for setting a repeat count of 
said media other than said text media on the basis of said display time period of 
said text media calculated in said text display time calculation processing unit 
and said total playing time period of all said segments of said media other than 
said text media, 
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Oliver et al. teach that the <embed /> tag in Figure 16.3 also includes the 
autostart and loop attributes, which tell Netscape's LiveVideo plug-in to start playing the 
video when the page loads and to repeat it as long as the page is being displayed. 
Figure 16.4 shows the resulting page as viewed with Netscape 4 (p 1, first paragraph), 
which meet the limitation of said contents conversion processing unit making a 
conversion of said media other than said text media included in said input 
multimedia contents on the basis of said repeat count set in said repeat count 
setting processing unit. 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine the invention of Nielsen with that of Oliver et al. because such a 
combination would provide the users of Nielsen with the benefit of an advanced method 
of Embedding Video in a Web Page (pp 1 and 2). 

16. Regarding claims 11 and 15, the claims incorporate substantially similar subject 
matter as claim 4 and are rejected along the same rationale. 

Allowable Subject Matter 

17. Claims 5 - 7 are objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 
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Conclusion 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nathan Hillery whose telephone number is (571) 272- 
4091 . The examiner can normally be reached on M - F, 1 0:30 a.m. - 7:00 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather R. Herndon can be reached on (571) 272-4136. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 



Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



273-8300. 
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